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ABSTRACT 

This paper deals with the identification of NARX (Nonlinear Au- 
LoRegre&sion with eXlra input) models for the numerical simu- 
lation of circuit containing nonlinear dynamic elements. NARX 
identification, based on a sequence of input/output samples, is use- 
ful for black-box modeling and for the refinement of models of 
nonlinear circuit elements. In order to assess the suitability of 
such an approach, we apply it to a CMOS inverter gate and experi- 
ment with the main elements controlling the identification process. 
We obtain accurate models with relatively simple structure and ob- 
serve reliable operation of the identification process, as well as a 
good inseositivity to the noise content of the output samples. Such 
results confirm that NARX identification could be a useful tool for 
circuit simulations. 

1. INTRODUCTION 

The development of efficient and accurate numerical models to de- 
scribe the behavior of circuit elements is of paramount importance 
in the area of circuit simulation. In particular, the availability of 
techniques for the black-box modeling of nonlinear dynamic cir- 
cuit elements and for the simplification (Le„ order reduction) of 
existing models would he very useful- Black-box modeling is the 
most general approach to the description of poorly known devices, 
whereas model simplification allows the balancing of model accu- 
racy and efficiency. 

The latter point is going to be a dominant issue of future simu- 
lation problems. In fact, as circuit applications become more com- 
plex and their operation more critical, conventional circuit simula- 
tion and functional simulation become ineffective, since they are, 
respectively, too expensive and/or too idealized. Fast digital cir- 
cuits are important examples of this evolution. Their short switch- 
ing times activate many parasitic effects and require the use of non 
ideal models, whereas their size limits the complexity of models 
that can be used. However, for logic gates, the trade -off between 
model accuracy and complexity is not trivial. The transistor level 
description of gates leads to complex models, not affordable in the 
simulation of realistic prohlems, whereas simpler non idea I models 
are hardly devised. 

In this scenario, the NARX models could provide a useful 
modeling approach. Such models are the extension of the widely 
used ARX models to nonlinear systems and are general enough 
to describe a wide class of them (e.g.. see [1]), possibly including 
many nonlinear electric and electronic components. Th* identifi- 
cation of NARX models from input/output signals could be ex- 
ploited for both the black-box modeling and the refinement of 



models of nonlinear circuit elements. Besides, NARX identifica- 
tion could be applied to the input/output signals of existing accu- 
rate models as a method for their simplification. Although such a 
method has a brute-force nature, its use is justified by lack of sys- 
tematic methods for the direct simplification of nonlinear models 

NARX models have been widely studied in the area of control 
systems, where suitable identification algorithms have been devel- 
oped and successfully applied to moderately nonlinear dynamic 
systems [3]. Also, the direct derivation of NARX models from 
nonlinear differential models and a discussion of their effective- 
ness in the modeling of physical systems have been carried out 
K)- 

In this paper, we try to assess the performances o f NARX mod* 
els and of their identification in the modeling of highly nonlinear 
fast dynamic circuit elements. We carry out the study by apply- 
ing the NARX identification algorithm proposed in [5] to a CMOS 
inverter and by experimenting with the relevant identification pa- 
rameters. Since the inverter is the basic clement of logic gates, the 
results obtained in this study should give a first indication of the 
possibilities of the considered approach in the modeling of digital 
devices. 

2. IDENTIFICATION ALGORITHM 

NARX models are discrete-time linear- in-parameter models de- 
fined by Kolmogorov-Gabor polynomials [5] 
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X = {u(Jk),t,(fc-l) u (*-r) iy (*-l) V(fc-r)} C2) 

where w(Jfe). e(k) and y{k) are the samples at the k-th time point 
of the input, disturbance and output signals, respectively, x p is the 
generic element of X, ie. t the present sample of « or the past 
samples of u and y up to the time k - r, and 7 = 2r + 1. The 
integer variables r and 0 are the dynamic order and the nonlinear 
decree of the model, respectively. Every possible product of up to 
q elements of X is a potential component of the model and appears 
in (I). The potential components with nonzero coefficients are 
the model actual components (or components in short) and their 
coefficients are the model parameters. 
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In order to identify a NARX mode) from a sequence of in- 
put/output samples (i.e., to select the components of the model and 
compute their parameters), we implement and use the algorithm of 
Portman et Al. [5]. Since the number of potential components that 
can compose a NARX model grows rapidly with r and <?. mak- 
ing the identification computationally expensive, we base our im- 
plementation on a step forward approach. In such an approach, 
the model is built by starting from a minimal guess model (possi- 
bly with no components) and by adding al each step the potential 
component that mostly reduces the model mean -square error. 

In detail, the implemented identification algorithm is orga- 
nised as follows. A model dynamic order r and a nonlinear degree 
q are chosen. The model dynamic order is estimated a priori from 
the input/output sequence by the algorithm of [6], whereas the non- 
linear degree is estimated empirically. Such a choice defines the 
set of potential components. Then a guess model is decided and 
the following three steps are repeated. 

1. The reduction of the model mean-square error produced by 
each potential component not in the current model is estimated 
off-line by orthogonal ization of the time sequences [5\. A new 
model is generated by adding to the current one the potential 
component that minimizes the mean-square error. 

2. The stability of the new model is verified and, if necessary, the 
added component is discarded. 

3. For the new model, Ihe values of suitable statistical indexes are 
computed [5]. 

Each execution of tlie above steps generates a new model, whose 
statistical significance is assessed by the index values computed in 
step (3). When a new model has values of the statistical indexes 
not better than the previous one, the process is terminated and the 
model with the best values of the statistical indexes is retained as 
the final one. Eventually, the final model is validated by checking 
its ability to reproduce the system output for input signals different 
from those used in the identification process. 

As an example, we apply the above procedure to the inpul/- 
output sequences of a NARX test system and verify its ability to 
correctly retrieve such system. The test system is defined by the 
following particular Kolmogorov-Gabor polynomial with r == 1 
and q = 1 

y(Jt) = 0.2025 + 0.405y(* - 1) + 0.09u(fc - 1) 
+ 0.0008v 4 (k - I) -0.0056ti(Jk - l)t/(* - I) 
+ 0.177j, a <* - 1) + 0.09u(* - L)y{k - I) * ' 

- 0.0253)/* (* - 1) +0.01rj 2 (fc - 1) 

The input identification sequence used is obtained by sampling a 
random multilevel signal with a small white noise superimposed. 
The identification sequence has 3600 samples, and its level vari- 
ations are wide enough to highlight the nonlinear nature of (3). 
Table 1 shows the main figures of some of the models generated 
by the identification procedure for this example. Each row of such 
a Table describes a different model and lists, from left to right, 
the number of components of the model (n). the maximum value 
(e m *«) and the variance (<r?) of the error between the model and 
the reference outputs, and the value of the OVF index [5]. The 
OVF index is a decreasing function of <t\ and of n. so that its 
maximum should indicate the most significant model of the se- 
quence. For this example, the OVF index is maximum for the 
model with n — 9 (see the bold row of Tab. I), which indeed 
coincides with the original system. The detailed structure of mod- 
els with n = 8, 9, 10 is reported in Tab. 2. Models with n < 9 
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Table 1 : Main figures for models of the example of Sec. 2 . 
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Table 2: Structure of models of the example of Sec. 2 . 



are composed of a subset of the component of the original system 
and their parameters approximate the corresponding parameters of 
the original system. On the other hand, models with n > 9 have 
the same components and parameters of the original systems plus 
spurious components with negligibly small coefficients. 

3. NARX INVERTER MODELS 

Tn this Section, we address the NAKX modeling of logic gates by 
applying the identification algorithm of Sec. 2 to an inverter gate 
of CMOS technology. We generate the output sequences for the 
identification process via Spice simulations based on the CMOS 
level 2 model, which is a detailed transistor model including sev- 
eral parasitics. The simulated output sequences are used either 
directly, to identify NARX models as simple as possible (model 
simplification), or corrupted by noise, to reproduce identification 
from measured data (black-box modeling). 

We start by considering a Single Input Single Output (SISO) 
configuration of the inverter system, obtained by loading the in- 
verter with an identical one and by using the voltages at its input 
and output ports as the input (u(tj) and the output (y(t)) signals, 
respectively. For this system, the estimated order is r = 1 and 
we start with q = 3 and a guess model with no components. The 
identification process yields the sequence of models described in 
Tab. 3. Since the modeled system is not of NARX type, the fig- 
ures of Tab. 3 do not show the net threshold phenomenon shown 
in Tab. 1 . However, among the identified models, the one with 
the maximum value of the OVF index (n = 8) still reveals the 
most faithful static and dynamic behavior and can be considered 
the final model. Furthermore, as in the example of Sec. 2, die pa- 
rameters of the models with » - 0 and 7 stiiJ approximate the 
corresponding parameters of the model with n = 8. The accuracy 
of the model with n = 8 is good and can be appreciated in Fig. I , 
where its response to a validation input (iL«., a signal different troin 
the identification input) and the reference response of the original 
system are compared. Finally, the complete identification process 
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Tabic 3: Main figures of NARX models obtained for a CMOS in- 
verier in SISO configuration by using r = 1. q = 3 and a guess 
model with no components 

to obtain this model requires about 20 s on a 60 MHz Pentium PC. 



Then we consider the ability of the identification process to 
obtain models from corrupted output sequences, which is the key 
property required to use NARX identification for black-box mod- 
eling. To check such an ability, we add white noise signals of dif- 
ferent variance to the simulated output signal and use the resulting 
signal for the identification. In this way. wc observe remarkably 
good insensitivity to the added noise. In fact, the identification 
process works also for the noisy output sequences and the final 
model is hardly affected (i.e.. has the same components and pa- 
rameter values) for SNR values as low as 25 dB. Moreover, though 
lower values of the SNR of the output sequence lead to different 
final models, such models remain able to reproduce the qualita- 
tive behavior of the original system. As an example. Fig. 2 and 
Fig. 3 show, respectively, a part of a noisy output identification se- 
quence and a response of the model identified from such a noisy 
sequence. In this example, the output identification sequence has 
SNR= 20 dB, and the response of the identified model to a vali- 
dation signal, shown in Fig. 3, still tracks the reference output 
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Figure 1: Reference response to a validation signal (solid line} 
compared with the response of the n = 8 model of Tab. 3 (dashed 
line) 

In order to further assess the performance of NARX identifi- 
cation on the inverter device, we carry out a complete set of iden- 
tification experiments for the simple SISO configuration. 

The first point considered in such experiments is the influence 
of the guess model. In fact, the sensitivity of the NARX identifica- 
tion to the order in which the model components are selected is a 
known weakness (4], and the guess model affects such order. We 
verify that guess models defined by a subset of the components of 
the n = 8 model of Tab. 3 lead to the same final model. In contrast, 
guess models with components not in the n = 8 model may lead 
to different final models and show that the pure forward approach 
does not ensure the neutralization of inappropriate components. 

The next clement considered is the identification signal. The 
selection of suitable identification signals is a critical point in the 
identification of nonlinear system, because of the lack of theoreti- 
cal guidelines. We try different types of identification signals and 
different lengths of the identification sequences. The best results 
are obtained with the random multilevel signals defined in Sec. 2 
when the constant levels last enough in comparison with the sys- 
tem "local lime constants". In this case wc observe good identifi- 
cation properties and a weak sensitivity of the variance error to the 
length of the identification sequence. 




300 400 
k 



700 



Figure 2: Samples of an output identification sequence. Solid line: 
exact values; dots: values after the addition of a noise signal with 
S#R= 20 dB 
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Figure 3: Reference response to a validation signal (solid tine) 
compared with the response of a model identified from the noisy 
sequence of Fig. 2 (dashed line) 

Finally, we check die sensitivity of the models to the non lin- 
ear degree q by identifying NARX inverter models with different q 
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vahics. Such experiments highlight the ability of the NARX mod- 
els to represent highly nonlinear systems even for moderate q val- 
ues. In these comparisons, the static characteristic of the model is 
used as an additional index of its ability to reproduce the nonlinear 
behavior of the original system. For q — 2, the shape of the static 
characteristic cannot be obtained and the identifi cation fails. For 
q 3, instead, the characteristic is correctly reproduced and the 
accurate model with n = 8 of Tab. 3 is obtained. Moreover, the 
value q = 3 turns out to be an optimum choice for the problem at 
hand, as higher q values yield only minor improvements. This can 
be appreciated in Fig. 4, where the reference characteristic and the 
characteristics of two models with 7 = 3 and 7 = 4 arc shown. 
An interesting method to improve the accuracy of NARX models 
without increasing q (nnd hence n) is the use of picccwisc models 
(5J. We identify a piecewise model composed of two submodels 
with r = 1, q = 3 and n = 7, which works safely and is more 
accurate than die model with n = 8 of T^b. 3. The variance of 
its error, is one order of magnitude smaller than the one re- 
ported in Tab. J and its response to the validation signal is better 
than the one shown in Fig. 1 (results arc not presented for lack of 
space). In such a 2-piece model, the submodel domains are the 
two half planes y < 2.5 and y > 2.S, whereas the switching rule 
is hysteretic and takes into account the last two y samples. 



waveform v 2 (k) obtained by the MIMO model tracks well the ref- 
erence response of the simple test circuit. 
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Figure 4: Static characteristics of the CMOS inverter (solid line), 
of the model with 7 = 3 and n = 8 of Tab. 3 (dashed tine) and of a 
model with q — 4 and n — 12 (dotted line) 

SISO models are useful to assess the possibilities of the NARX 
approach, but the representation of multiport circuit elements re- 
quires Multiple Input Multiple Output (MIMO) models. In the in- 
verter example, we deal with a 2 -port element, where, in principle, 
two of its port variables arc controlled by the other two variables. 
Since CMOS gates operate by forcing the voltages of their out- 
put ports, the natural input and output variables of the inverter 
circuit are u : , i 2 and vj, t] , respectively, defined in the insert 
of Fig. 5, We identify a NARX MIMO inverter model by excit- 
ing the circuit through the input variables vi and 12 and by using 
r = 1 and g = 4. The algorithm is applied to a set r defined as 
X = (vi(fc). vi(*- l),i7(fc),M*- I)} and. in spite 

of the increase of the number of potential components, the iden- 
tification remains affordable and produces accurate models. The 
best MIMO model obtained in this way has 16 components and its 
accuracy can be appreciated in Fig. 5. Such a Figure shows the 
waveform vj(Jfc) produced by the MIMO model when it is loaded 
by a capacitor and is driven by a validation sequence vi n (k). The 
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Figure 5; Waveform t^(Jt) of the circuit of the insert for a vali- 
dation input vi n . Solid curve: reference response; dashed curve: 
response produced by the NARX MIMO inverter model described 
in the /«/ 



4. CONCLUSION 

In this work, we investigate the performances of NARX identifica- 
tion applied to a dynamic highly nonlinear two-port element: the 
CMOS inverter The numerical test carried out shows that such an 
approach has the potential to handle this type of nonlinear systems. 
The identification process yields accurate models with a moder- 
ate number of components, is robust and is practicable also for 
multiple inputs. Although many aspects should be further inves- 
tigated before practical applications, the results obtained suggest 
that NARX identifi cation couid be a useful tool for circuit simula- 
tions. 
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